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instructional .level' reading passages> standard errors of measurement. ^ 
(SEMs) were calculated and analyses of covariahce were run on the 
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Abstract ' > • , ; 

^ ' 'Two studies were conducted to compare the performance Instability 
of chrldren labeled " learning^ dilableH-Zbrarn injuredh (LD/BI) . to the 
perforTnan^ce instability of emoti^onally handicapped (EH) chiTdren. In 
'the first study, 5b LD/BI and 37. Eft students were measured cm three 
third grade reading passages -twice, once Within .one sitting and 6nce 
with the three i)'assages, administered! during three, consecutive weeks/ 
In tl?^ 'second study, a subsample of 43 students (24 LD/BI and 19 EH) 
^ were ^measured on instructional level^ r^eading passages 28 to 47 times 
within^ 18^ schooT weeks/^ OnVthfe words correct scores 'on each 
administVation 6f the third^grade passage reading test and oh the word 
/ correct and errors, scores^ on the Instructional -level reading passages, 
. standard errors of measurement (SEi^s) were calculated an^ analyses of 
/covariance. were -run oh the --SEMs. Results indicated- no difference 
between* the performance instability of the two groups of children. 
'Implications- for identifying and treating LD/BI- and EH students are 
discussed/ v ' • * ' ' * , 



variability of Performance: A "Signature" Characteristic, 

' ^ of Learning^ Disabled Children 

The work . of Alfred Strauss -^nd,^ his associates was eT^mjor 

catalyst for the LD field, (cf. Lerner, 198;). Strauss suggestecl that 

a subgroup'Of EMR children deserved to ' be jyiewed as qualitatively 

different from other EMR children 'on the basis of th^ir unique ^, 

perceptual, cognitive, and soc'iaT behaviors, which, accord ing~~tto 

Strauss, was caused by. brain injury (Strauss & Lehtinen, 1947). 

Despite the continued -influence of , the brain injury (BI), perspective, 

_ if. . 

as-reflected in both current educational practice and research, it has' 

. ■ •■ " ' ' V -,v 

generated widespread dissatisfaction. During the 'past two decades, 

^numerous ?nd well-documented alternative conceptualizations and 
p • > . . . 

descriptions of learning disabilities have been generated (cf. SinitTvf'^" 
1983). The large numbe^<«nd diversity of these competi^ng tfefinitions- 

have . led • some to suggest that there are few, if am se^lient 

. ■ ' '. ^ 

Jbehayiorll characteristics to distinguish LD" children from other ^ 
mildly handicapped children, such as those who 'are labeled mentally- 
retarded and emotionally disturbed (Hallahan & Kauffman^_1977)\ ^ i 
Nevertheless, there are certain descriptions of LD/ai children I 



I 



that have endured from Strauss to the present. One such desc^-iptor is 
instability of functioning, or a tendency to demonstrate variable 
perfbrmance on the same ' task . from one day to tlje next. Strauss and 
Lehtinen '(1947), for example, reported dramatic 'performance 
t;)istability among students. Similarly, Ebersole, Kephart, and 
Ebersole (1968) indicated that LD/BI children inconsistently retained 
material that previously was learned.^ Recently, Swahson (1982) 
described this population of pupils as performing in a fragmented, 



inconsistent, and .v.ariable manner* He proposed that such beliavior is 



.acknowledged impiicitly in purrent research into selective attention. 



/ Despite the seeming consistency of these observations and the 
agreement among teachers about the extent and importance of 



performance instability (cf. Aviezer & Simpson, 1980), there has been 

• ' . . •* 
scant empirical investigation -reported. In the only 'identified data-~ 

based study, Aviezer 'and Simpson (1980)- tested 40 non-handicapped 

^children and 34 LD/BI children on perceptual, cognitive, and reading* 

* tasks th^f^ee times, with 'a two-week interval between the first- and . 
second testings and with<; a two-month interval between the'seconcl and 
thir^ administratons • Instability was"" operational ized as a decrease 
in score with task repetition; stability * was defined as performance' 
constancy or improvement.' Young children, , regardless of their 
subgroup identification,^ tended to be unstable in. performance, whereas 
differences wene found, in stability, as a function of subgroup far 
older stOdents CLD/BI -10 and H-year olc|s displayed mor^ unstable 
performance than the i rl rfon-handi capped peers),'' 

thus, Aviezer and Simpson (1980) provided ^ scTme support for-,the 
notion that .at least older LD/^I childi^rr'lnayl[*^be characterized by 
performance instability. Hc^&Ver, two limitations^ of this study^are 
noteworthy: first, the qUestibnable meaninqfulness of the definitions 
of instability/stability; second, the absence of a^xtJfiiparison between* 
the instability of ID/BI -children and the instability of children^ 
constituting different categories "pf exceptionality. .Because of this 
second study limitation, it^ r/emains unclear whether performance\ 
instability characterizes only^ LD/BI children or is associated with 



( 



additional gr^Qups, of children experiencing serious learning 'problems 
and academic retardation. Such ambiguity necessarily precluues the 



usefulness of peV-formance instabil^ity in^ certain 'clinical e'ndeavors, 
such . as in conducting differential diagnoses, and in theoreticajl 
conceptualizations and research./- - v - • ^ 

The purpose of the present ser,ies of interrelatv^d investigations^ 
was to expVore the . legitiVnady ' of the , belief that perfoVmarice 
instability. is a distinguishing fe'atcjre of LD/BI pupils. Toward this 

end, these studies employed (a) two groups /!of ' older handicapped 

'• " ■ ' . ' » • ■ 

children, LD/BI and emotionally^andicapped (EH-), and-'O)/) a more 

appropriate inqex of stability,-^ th$. standard error of measurement 



^crass .repeated administrations of'^siinflar tasl<s. - , \ 

In Study 1, reading/ performance instability was"*^mpared' f qr EH 



J* 



and LD/BI pupils under two conditions. In the first conditi\)n, 

instability across three reading me^surefnents, which occurred at onQ''- 

week intervals, was examined. In the; second- condition, instability 

across . three^ reading measurements occurring within one 8-minute 

, session was explored. , " * 

Method J \ ' - . . . 

Subjects ,.. The' samp l>e included 87 pupils 'from seven^New York City 

pi'.blic schools. Fifty subjects (57^)- were, classified EH, and 37 

> i ,- ^ . " 

students (43%) were -labeled LD/BI. EH students (37 M, 13 F) read' an 

.average 2.59 years belpw grade level (SO = 2.01),- and had spent an 

Average 2.89 years in special education classes (SD =.1.81). The 

numbers of EH students placed in grades 4-9, respectively, were 10, 9, 



"8, 15,7", and 1. In the LD/BI group (24 M, 13 F), students read an 
average 3^51 years below -grade level (SD = 1.69), and had spent an 
• .^average 2.71 .years in special edu(;ation classes (SD = 1.35). The 
^numbers of LD/Bt children placed in grades 3-8, respectively were 1, 
6, 10, 9, 6; and 5. " . ' • 

statistical tests. revea;1ed that EH and LD/B^I groups were' similar 
with respect to sex, }(?,(^)' = 1.40, ns, grajle level , pi acement, x^iS) = 
5.68, ns, and years spent iti special education, ,t(85) = .51, ns_. 
^ 'Howev^er, the LC(7BI students wer*e farther below grade \evel^in reading, 
t(85) = ^„25, ^< ;025'.' _ . , f / • , 

Measures . The^ Passage Readitiq Test (PRT) was employed which is 
compri-sed of three -reading passages from a thTrd grade book of the 
Qion 720 series (1976). Two passages were^ampled randomly from the. 
text and 'one' was chosen to repre^nt the readability of the' last 25% 
of the book, i (Sefe. Fuchs, Fuchs, & Deno, 1982, ■ for selection 
procedure.) The PRT requires stude^n.ts to read aloud from each passage 
fbr one minute, and ^stud^ent performance^ is reported in terms , of the" 
number of correct words read. Testrretest reliability co^j^f icients 
ranged from .93 to/. 96 (Fuchs, Deno, &'Marstbn, in press). 'Concurrent 

0 

validity coeff icientSf with respect to the Woodcock Readini^ Mastery 

. ' ^ : . . \ 

Tests, Word Identification and Passage Comprehension Tests, ranged 

V ' ^ y 

from .89^ to .92 .{Fuchs,- 1981). Internal consisterrc^reliability 
(Cronbach*s alpha) for the three passage test was .79 (Fuchs, Deno, & 
—firkin, 1982). \ ^ 

Procedure . The PRT was administered twice ^to each student, with 



,four schooT months intervening between administrations! During ^he 

.9 ^ 



first administration (Time 1), students iread from a diff^^nt passage 
each week, for th>ee consecutive ^weeks. '-During the secoi^ 
•administration (Time 2), students read from the three passages on one 
day. The tests were administered individually,, with total . testing 
time for ea^cTi of the two admi nistrations^^nging from 4 to 8 minijtes. 
All examiners were trained in standard - administration, procedures (see 
Mirkin, Deno, FOchs/, Wesson, Tindal-, Marston, & Kuehnle, 1981), 

D ata analysis . Because initial data * indicated that the LD/BI, 
students were poorer readi^rs %ar] tbe EH children, preliminary t_ tests 
weren^erf-ornjed on the 'average ^number of correct words across the three 
passages onVeach administration of the PRT, On- both administrations 

there was ^a statistical ly significant difflrerice favoring the reading ( 

<l \ ■ ■ 

performance of the EH group; t(85) f 2,04, p < .05 and t{85) = 3,65., p 
< ,001, at Time 1 and T^me 2, respectively, Or| the first- 



administration, EH children read correctly a mean 67.12/words (SO = 

56.42)^ and LD/BI pupils read correctly a mean 45,45 words (S^ = 

36,75); on the secdnd administration,, the means for the number of 

word^ read correctly were 67,17 .{SD<c^ 46.33) and 33,71 (SO - 23.95) 

for the EH and LD/BI .grrou^; respectively. ' 

Since theyEH average performance "on. the PRT. was higlter tharj that 

of the LD/BI pupils, there was a greater r^^'nge of behaviojr and more 

potential instability for the LD students. In order to x:antVol for 

this source (}f . error in^^the comparison of performance i;istability, 

tworway analyses of covari ance (ANCOVAs) were run. In each analysis, 

• - . ^ . ■■' 

the standard eirrdr of measurement across the three-passage test, an 

index of intra-i.ndividual ^variabil ity, was the dependent variable. 



•tt. 



ERIC 



. -^r 
/Student classification was the indepen'Sent variable, with sex employed 

as a .blocking factor/. The/ average 'dumber -of words read correctly 
across the 'tbree-passage- tesjts was entered as the "covariate. 
> Results and 'Discu ssion^'' :^ » '., • , - ' ' 

^ Tab|f-r shows the -means, adjusted ^means, and the ANCOVA resul'ts" 
^for 'ihS^ standard error of estimate on the/ first ' a,nd secon^d' 
administrations of the PRT. The two-way ANCOVAs revealed no 
statisp'caTly significant^ffept for the ind^endent factor, Student 
Classification,' at either administration. Additionally, there was -no 
statistically significant effect for the blocking factor. Sex, £(1.81)' 

1.32, ns^ and F_(l.-^1) = .85, rls, at Times 1 and 2, respectively, or 
• ' ' ' " ' • 1 * 

for the interaction between Student CI assification and Sex', F(1.81) = 
.34, ns and F(1.81) =. .00, ns, at Times 1 and 2, respectively. ■ 



^_ 



Insert Table 1 ab^^ut .here 

i 



Therefore,, there was no i^eliable difference in, the intra- 
ihdividual reading performance variability between the EH and LO/BI 
children. This finding .remained .unchanged vyhen instability acrqss 
week-Ion^ intervals (first! {dministration of the PRT) 'or within a 
relatively short time frame (second , PRT administration) was examined. 
Additionally, ther.e appeared to be little, if. any, practical 
significance in the instability of these groups of children; adjusted 
mean standard error of estimates for the PRT Time 1 and Time 2 
admin istj:.at ions, res"pectively, were 1.30 and '.60 words correct. 



) 
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While Study 1. examined the ijTij;^a-indivVdija"l ' instabiffty across 
three m.easurements on, third ^gradg passages 'administered at different 
time intervals (at one-Week intervals or within^ 8 -minutes). Study 2 

■ • . , ^ . • ' ': . ■ 

•explored iTitra-incnvidua1-'.rinstabil ity across 'many, more measurement 

• • « « * 

points (28. to 47) on an inj,truc£iona1 level oral • p'cis'sage reading ta$k 
administered at, interval's of one day to several schoo.l-d^ys. Tjfe 
purpose of tMs opefati'onal .reP"Hcate (Borg &.Gall, 1979) of the firs\ 
study was jto', examine- whether potential artifacts of -the" experimental 
•prpcedure, ^'specifically either >(a) ^he relatively few d.ata^^ints 
collect^, oK>fb> the use ef- a third grade passage"test rather than 
instrtictional level material, might have accounted for- th^ findings'^of 
no d-iff eren^. ■ . • . . 

Method " • ' . 



Subjects / ,A randomly selected subsamplja^of 43 children * frem 
Study r,' representing the EH an^d LD/BI categories in nearly the same 
percentages (56^ EH and 44^ LD/BI)', served. as subjects in Study 2. £H 
• students^ 18 'W, 6 F) read an average 3.14 years below grade level'^ (SD 
= 2.04) and had' spent an- average ^^2.61 years ^in special education 
classes (SD = 1.97). -The numbers of EH students placed in grades 4-9; 
respectively, we>'e .4, 4, 5,^5,^ 5, and 1. • LD/BI (14 M, 5 F)''students 
.read an average 4.2^6 yeaps" below grade level (SD = 1.32), and haa, 
spent an average 2.66 years in special education (SD = 1.31). The 
numbers pf LD/BI children^ placed in grades 3-8, respectively, were 1, 
5,. 6, 4, and 3, ' ' . ^ 

, Statistical tests' revealed that EH and LD/BI groups were similar' 
With respect to sex, x^(l)" = .01, ns, grade level placement, x^(5) = 



5.03, ns_^ and years ^ spent in speci^al education, ' t^f 41) = .05, jts. 
However* the reading achievement of the LD/BS . students was farther'"' 
below grade level than the reading achievement of the EH pupils, t(41) 
= 2.07, £ < .05. - . . 

- Procedure . For 18 scfiool weeks, subjects' teachers implemented, 
ongoing currdculum-based .measurement.' Teachers selected for each 
child an instructional level 'book arid, at least twice weekly, randomly 
chose a passage from that book on which ' to measure the child's 
performance. Employing a standard administration procedure (see 
Mirkin et al., 1981), teachers required the student to read orally for 
one minute, and marked errors including ^bmissions, "vsubstitutions,' 
insertions, and mispronunciations. Teachers then graphed the numbers 
of words correct and*>errors read. Teachers were trained to design and 
implement this measurement system in weekly individual meeting's with 
teacher trainers. * Within the 18-week implementation, each teacher was 
observed three times while measuritig a student. The observers rated 
the .accuracy with which the teachers (a) administered the measurement 
task, and (b) graphed the data, each on a 5-point Likert-type scale. 
The ratings, averaged across, . teachers and across the three 
observations, for task administrationTarid data graphing, respectively, 

• were 4.80, and ,4.2! (Fuchs, Deno, & MirkMn, 1982). ' 

Data analysis . Because preliminary data suggested a discrepancy 

^between the reading skills of EH and LD/BT children, preliminary jt 
tests were conducted on the numbers of words correct and errors 
averaged across each student *s graphed data. EH students read more 
words correctly, t^(41) = 2.58, £ < .02^. with the average scores for 



the EH and LD/BI groups, respectively, 60.23 ^(SD = 44.49) and 30.78 
(SD = 26.57). EH chilcTrgn also made fewer errqrs, t(41) = -4.06,' £ < 
'.001, with the mean scores for the EH and LD/BI groups, respectively, 
6.05 (St) = 4.4^) and ll:-65 (S[> = 4.57). 

Given the greater r^nge of behavior and potential instability for 
the EH students on words correct and for the LD/BI pupil's^ on errors, 
two two-way ANCOVAs were employed: one analysis for word correct 
scores and 'on^ for' error scores. In each analyses, the standard error 
Of measurement (on either words correct or errors) across each 
student's 28 to 47 graphed data points was the dependent variable. 
Student classification was the independent variable, with sex employed 
as a blocking factor. The^^average number of words correct across the 
graphed data was entered as the covariate whei? the standard error of 
measurement on words correct was employed as the dependent variable; 
the average number of errors was entered ' as ^the covariate wTfeff'^^the 
Standard error of measurement on .errors was used as the dependent 
variable, i 
. Results and Discussion 

Table 2 displays the means, adjusted means, and the ANCOVA 
results for the differences in standard error of measurement on words 
correct and errors. As shown, there was no statistically significant 

difference in the standard error of measurement '^for the independent 

' / ■ 

factor. Student Classification, on ei^ther words correct or errors. 
Additionally, there was no statistically significant effect for Sex as 
the blocking factors, F(l,37) = .41, ns_ and F(l,37) = .18, ^li, on 
-words correct and errors, respectively, or for the interaction between 

V/4 



10 " . ' - 

•student Classification and Sex, E^(-l,37) = 1.60, £S and £fl,37) =..00, 
nS; on words correct and errors, respectively. 



Insert Table' 2 about here 



Consequently, as in Study 1, .there were no reliable differences 
in the intra-.indi vidual instability between EH and LD/BI children. 
Additionally, there appeared to be no practical difference in the 
instability of these two groups of children; adjusted mean standard 
error of estimates for the two classes differed by only .60 words 
correct and .02 errors. Further, this operational replicate of Study 
1 indicates that findings of the two studies are not artifacts of 
specific methodological procedu/es employed, but rather appear to 
generalize across the number of data points collected as well as the 
|%vel of reading material employed. o 

General Discussion 

The purpose of the present studies was to compare the performance 
instability of two handicapped groups of - chi ldren--LD/BI and EH 
students. Results indicated that there were no, reliable differences 
between the two groups. Further, there appeare^ to be little 
practical ^difference in their performance instability. This finding 
was robust; the same question was explored in three different ways: 
(a) across three measurements on third grade reading mkterfal over 
three consecutive weeks, (b) across ^three measurements on third grade 
reading material within one session, and (c) across 28 1;o 47 
measurements on instructional level residing material ov^er 18 school 



, ' ' ^ ^ . , • 11 

weeks. In -each 'case, - results "indicated no difference in the 
'performance instabil ity of these two groups^ of. handicapped students. 

A - " . ■ \ ' 

Unlike the ^investigation by Aviezer and Simpson (1980), the 
present studies did'.not compare the performance instability of LD/BI 
children to non-handicapped children';, it remairts" quite possible that, 
in relation to^ their 'non-handicapped peers, LD/BI Students exhibit 
greater variabi 1 ity 'in their ' school ^4i|ict:ioning. How&ver, findings 
from the ^present studies do not support the use of performance 
instability as a "signature"or distinguishing characteristic or LD/BJ 
children. ^Results .indicate that- EH children displSiy this pattern/of 
behavior to a similar degree. Moreoever, there appears to be no 
reason to preclude the possibility that children^'in other categories 
of exceptionality ^^Iso^ may manifest similar ' variability of 
performance. ^ ^ . 

There appear to be at least two practical implications from these 
findings. First, although LD/BI childrerf historically have been 
described partly in terms of the variability of their performance, 
diagnosticians should not presume that this characteristic'^may serve 
to' differentiate reliably an LD/BI subgroup from other groups of 
handicapped children. Rather, findings are consonant with (a) 
ttaJJ Kauf f man ' s \(1977) vi ew, that there i s an absence of 

Characteristics wvtn wh'l.cly to make ^differential ^diagnoses among the 
mil dly-to-modera;tely-handicapping conditions, and (b) the notion "tl^feit 



sp.ecial educators* should identify handicapped children wi'thin a non- 

1 ' 

categorical^yKramework. Second, results indicate that recent / and 
/romising ^instructional strategies, such as metacogni tive training 



^' ' J _ J 

(cf. .Loper, 1982), that have been used with LD/^BI cihildren also might 
prove effective with EH and perhaps otRer^-trandi capped pupils. 
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